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(54) Method for modulating volume samples in a rendering pipeline 


(57) A method modulates samples in a volume ren- 
dering pipeline by storing modulation values as entries 
in a table. Also stored are a grain and a base for the 
entries of the table to specify an index range. A magni- 
tude of a gradient vector of a sample is determined. The 
table is indexed using the magnitude to determine two 

100 


modulation values corresponding to the magnitude. The 
two modulation values are interpolated using the grain 
and the base to determine a modulation factor to modu- 
late the sample with a linear function. 
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Description 

CROSS REFERENCES TO RELATED APPLICA- 
TIONS 

5 

[0001] This application is a continuation in part of 
U.S. Patent Application Serial No, 09/190,643 (attorney 
docket number VGO-109) "Fast Storage and Retrieval 
of intermediate values in a Real-Time Volume Render- 
ing System," filed by Kappler et al. on Nov. 12, 1998. io 
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Rendering Pipeline 

[0007] Volume rendering can be done by software 
or hardware. In one hardware implementation, the hard- 
ware is arranged as a multi-stage pipeline, see U.S. Pat- 
ent Application 09/190,643 "Fast Storage and Retrieval 
of Intermediate Values in a Real-Time Volume Render- 
ing System," filed by Kappler et al. on Nov. 12, 1998. 

Illumination 


FIELD OF THE INVENTION 

[0002] This invention relates generally to modulat- 
ing volume samples in a rendering pipeline, and more 
particularly, to modulating lighting values using gradient 
magnitude vectors and complex functions. 

BACKGROUND OF THE INVENTION 

Introduction to Volume Rendering 

[0003] Volume rendering is often used in computer 
graphics applications where three-dimensional data 
need to be visualized. The volume data can be scans of 
physical or medical objects, or atmospheric, geophysi- 
cal, or other scientific models where visualization of the 
data facilitates an understanding of the underlying real- 
world structures represented by the data. 
[0004] With volume rendering, the internal struc- 
ture, as well as the external surface features of physical 
objects and models are visualized. Voxels are usually 
the fundamental data items used in volume rendering. A 
voxel is a data item that represents a particular three- 
dimensional portion of the object or model. The coordi- 
nates (x, y t z) of each voxel map the voxels to positions 
within the represented object or model. 
[0005] A voxel represents some particular intensity 
value of the object or model. For a given volume, inten- 
sity values can be physical parameters, such as, den- 
sity, tissue type, elasticity, velocity, to name but a few. 
During rendering, the voxel values are converted to 
color and opacity (rgba) values which can be projected 
onto a two-dimensional image plane for viewing. 
[0006] One frequently used technique during ren- 
dering is ray-casting. A set of imaginary rays are cast 
through the array of voxels. The rays originate from a 
viewer's eye or from an image plane. The voxel values 
are re-sampled to points along the rays, and various 
techniques are known to convert the sampled values to 
pixel values. In particular, voxel values may be con- 
verted directly to rgba voxels, which are then re-sam- 
pled along rays and accumulated to pixel values. In 
either case, processing may proceed back-to-front, or 
front-to-back. * ■ 


[0008] Illumination is well-known in both art and 
computer graphics for increasing the realism of an 
image by adding highlights, reflections, and shadows, 

15 thereby appealing to one of the natural capabilities of 
the human eye to recognize three-dimensional objects. 
A number of prior art illumination techniques are known 
in computer graphics, generally involving complex cal- 
culations among the directions to each of the light 

20 sources, normal vectors to surfaces, and the position of 
the viewer. In polygon graphics systems, where the 
three-dimensional objects are depicted by partitioning 
their surfaces many small triangles, the normal at each 
point on a surface is easily obtained from the specifica- 

25 tion of the triangle containing that point. 

[0009] Naturally, it is a challenge for any graphics 
system to carry out these calculations quickly enough 
for real-time operation. One technique for performing 
them efficiently is described by Voorhies et al. in 

30 "Reflection Vector Shading Hardware," Computer 
Graphics Proceedings, Annual Conference Series, pp. 
163-166, 1994. They describe a polygon graphics sys- 
tem in which the calculations involving the eye vector 
and light sources are partially pre-computed for a fixed 

35 set of directions and stored in lookup tables. During ren- 
dering, reflection vectors are used to index into these 
tables to obtain values for modulating the intensities of 
the red, green, and blue colors assigned to the points on 
the surfaces of the objects depicted in the image. The 

40 only calculations necessary in real-time are for obtain- 
ing reflection vectors themselves and for applying the 
modulation. 

[0010] Applying illumination in volume graphics is 
more difficult because there are rarely any defined sur- 

45 faces in a volume data set. Instead, visible surfaces 
must be inferred from the data itself, as discussed by 
Levoy in "Display of Surfaces From Volume Data," IEEE 
Computer Graphics and Applications, May, 1988, pp. 
29-37. A common technique is to calculate gradients 

50 throughout the volume data set, that is the rates and 
directions of change of the voxel values with respect to 
position. At points where the gradient is strong, a sur- 
face or boundary between material types can be 
inferred, with the gradient pointing in the direction oppo- 

55 site to the normal of the surface. The magnitude of the 
gradient indicates the sharpness of the surface. In other 
words, where the surface is "fuzzy," the magnitude is a 
measure of the likelihood of the surface. Traditional illu- 
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mination techniques are then applied to modulate the 
color intensity and alpha values according to both the 
magnitude and direction of the gradient at each point in 
the volume, for example as described by Drebin, et al., 
in "Volume Rendering," Computer Graphics, August 5 
1988, pp. 65-74. By this method, features which exhibit 
high gradient magnitudes are accentuated as surfaces, 
while features which exhibit low gradient magnitudes 
are suppressed. 

[0011] Terwisschavan van Scheltinga et al. in 10 
"Design of On-Chip Reflectance Map," Eurographics 95 
Workshop on graphics Hardware, pp. 51-55, 1995, 
describe an application of the technique of Voorhies et 
al. to volume rendering. In that technique, specular and 
diffuse intensities are pre-computed based on direc- 15 
tions to light sources and the eye of the viewer. The 
intensities are then stored in lookup tables called 
reflectance maps. Gradient vectors are used to index 
into these tables to obtain the intensities for modulating 
rgba values at sample locations in order to produce 20 
specular and diffuse highlights. 

[0012] The above illumination techniques suffer 
from an inability to distinguish object surfaces from 
noise. Meaningful illumination can only take place when 
the samples can unequivocally be classified as surface 25 
or non-surface samples. Prior illuminators are inade- 
quate because the presence of noise can cause them to 
assign strong illumination to voxels within homogene- 
ous material. Neither Voorhies nor van Scheltinga sug- 
gest, teach or show illumination in a pipelined manner. 
Furthermore, the above techniques suffer a perform- 
ance penalty in having to reload the reflectance maps 
anytime a . view on an object changes. They do suggest 
computing a specular reflection vector on-the-fly, based 
on the gradient and eye vectors, which would obviate 
the need to reload the specular reflectance map when 
the view direction changes. 

Gradient Magnitude Approximation 

[0013] In the past, the brute force approach to 
determining gradient magnitudes included obtaining the 
sum of the squares of the gradient vector components 
(u, v t w) of the gradient vector G uvw , then deriving the 
square root of the this sum. This computation can be 
extremely hardware intensive, so software is often 
used. This is because the number of iterations neces- 
sary in doing a traditional square root calculation can be 
on the order of tens of steps. 

[0014] The hardware necessary and the time allot- so 
ted for such calculations is exceedingly complex and 
long, especially in view of a requirement for a real-time 
volume rendering, that needs to render at a rate of more 
than 500 million samples per second. Another prior art 
method for deriving gradient magnitude is by utilizing 55 
look-up tables, which suffers from the problem of the 
large number of gates required for any reasonable level 
of precision. 


[0015] After having derived gradient magnitudes, it 
is desirable to provide the user with the ability to use the 
gradient magnitude to interactively modify the applica- 
tion of lighting or a sample's opacity. This gives the user 
the ability to accentuate certain features, the ability to 
cut out certain features, or the ability to create a wide 
variety of alterations to the rendered object. 
[0016] It is desired to improve on these prior art 
deficiencies while illuminating volume data. More partic- 
ularly, it is desired to perform efficient and flexible illumi- 
nation as a stage of a hardware pipeline. 

SUMMARY OF THE INVENTION 

[0017] The invention provides a method for modu- 
lating samples in a volume rendering pipeline by storing 
modulation values as entries in a table. Also stored are 
a grain and a base for the entries of the table to specify 
an index range. 

[001 8] A magnitude of a gradient vector of a sample 
is determined. The table is indexed using the magnitude 
to determine two modulation values corresponding to 
the magnitude. The two modulation values are interpo- 
lated using the grain and the base to determine a mod- 
ulation factor to modulate the sample with- a linear 
function. 


BRIEF DESCRIPTION OF THE DRAWINGS 
30 [0019] 

Figure 1 is a block diagram of a rendering pipeline 
that uses the invention; 


35 


40 


45 


Figure 2 is a block diagram of an illumination stage 
of the pipeline according to the invention; 

Figure 3 is a block diagram of a gradient magnitude 
modulation unit; 

Figure 4 is a block diagram of a gradient magnitude 
range register; 

Figure 5 is a block diagram of a gradient magnitude 
modulation register; 

Figure 6 is a graph of a high pass filter function; 

Figure 7 is a block diagram of an attenuation func- 
tion; 

Figure 8a is a block diagram of a reflectance map- 
ping unit; 

Figure 8b is a block diagram of a circuit for comput- 
ing reflection vectors; 

Figure 9 is a block diagram of an eye vector regis- 
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ter; 

Figure 10 illustrates the reflection of an eye and 
reflection vector about a surface normal; 

Figure 1 1 is a block diagram of a lighting unit of the 
illumination stage; 

Figure Yd is a graph the Newton- Raphson square 
root approximation; 

Figure 13 is a block diagram of a pipelined square 
root approximation unit; and 

Figure14 is a graph comparing approximation 
results. 

DETAILED DESCRIPTION OF PREFERRED EMBOD- 
IMENTS 

[0020] Figure 1 shows a pipeline 100 that uses an 
illumination stage 200 according to the invention. The 
input to the pipeline is voxels 102 read from a voxel 
memory 1 01 , and the output of the pipeline is pixels 1 08 
written to a pixel memory 109. 

[0021] The stages of the pipeline 100 interpolate 
1 1 0 the voxels 1 02 for a particular point of view to pro- 
duce samples 103. During interpolation, the neighbor- 
hood of a voxel is examined, and values are assigned to 
sample points along rays. Typically, re-sampling func- 
tions include linear, probabilistic, or nearest neighbor 
interpolation. 

[0022] The samples 103 have their gradients 104 
estimated 120. Gradients indicate the direction and 
magnitude of surface normals. The samples 103 are 
then classified. The classified samples are illuminated 
according to the invention using the estimated gradients 
104 in stage 200. Last, the illuminated samples 106 are 
composited 140 to pixel values 108. In other embodi- 
ments, the order of the interpolation, gradient estima- 
tion, and classification stages may be different. 
[0023] The flow of data in the pipeline of Figure 1 
makes it possible to achieve considerable parallelism in 
a semiconductor or hardware implementation. While 
one group of data are being read from voxel memory 
101 , a previously read group is interpolated in the inter- 
polation stages 1 10, a group read before that is having 
gradients estimated and being classified in stages 120, 
etc. The pipeline reads a fixed number of voxels in each 
cycle, and these progress through the pipeline stage- 
by-stage and cycle-by-cycle. Therefore, even though 
the number of stages and length of time needed for ren- 
dering an individual voxel or sample may be large, many 
voxels are processed at any one time. 

Illumination Stage 

[0024] Figure 2 shows an illumination stage 200 for 


a hardware rendering pipeline according to the inven- 
tion. The stage 200 includes three major units, namely 
gradient magnitude modulation 300, reflectance map- 
ping 800, and lighting 1100. The stage 200 also 

5 includes four arithmetic logic units (ALUs), i.e., multipli- 
ers (<8>) 201-204, and a multiplexer (MUX) 210. 
[0025] Each input to the stage 200 comprises an 
already classified sample 205 from the previous stage, 
its corresponding gradient vector (G uvw ) 104, and an 

10 eye vector (E uvw ) 801 representing the direction from 
the sample point to the eye of the viewer. The sample 
and its associated gradient vector are received at the 
rate of one pair per pipeline clock cycle. In a system in 
which volume rendering produces a parallel projection, 

15 the eye vector is constant throughout the volume. How- 
ever, in the case of perspective projection, the eye vec- 
tor must be adjusted for each ray. 

[0026] The illumination stage 200 applies specular 
(s), diffuse (d) and emissive (e) lighting to the classified 

20 sample 205 using its associated gradient vector (G uvw ) 
104, and other controls described in detail below. The 
illumination stage 200 according to the invention, in 
pipeline fashion, processes sample and vectors at the 
rate of one pair per pipeline clock cycle. That is, it com- 

25 prises a fixed number of processing steps, and data 
flows through the stage in one direction from beginning 
to end. There are no loops, feedback, or variation in the 
number of steps of processing. Each of the sub-units of 
illumination stage 200 is likewise organized in pipeline 

30 fashion to accept inputs at the rate of one per cycle and 
to product outputs at the same rate. 
[0027] The gradient vector 104 is provided as input 
to the modulation unit 300, and the reflectance map unit 
800, described below. The modulation unit generates 

35 four gradient magnitude modulation factors GMOM, 
GMIM e , GMIM d , and GMIM S . GMOM is the factor for 
opacity modulation, and the other three factors modu- 
late color (RGB) intensities for emissive (e), diffuse (d), 
and specular (s) lighting, respectively. Modulation can 

40 be done in a number of different ways under user con- 
trol. 

[0028] GMOM modulates or attenuates (201) the 
alpha (opacity) component 206 of the classified sample 
205, supplied via the mux 210. The mux 210 also 

45 receives G uvw in the case that the illumination stage is 
bypassed altogether. GMIM e is multiplied in 202 by k© 
where kg represents the intensity of the emissive light- 
ing, a constant for the entire volume. The modulated ke 
is denoted by Ml^. GMIM d is multiplied in 203 by l d to 

so produce a modulated diffuse intensity Ml d . GMIM S is 
multiplied in 204 by l s to produce a specular lighting 
intensity Ml s . The values l d and J s are provided via the 
reflectance mapping unit 800. Mke, Ml dt and Ml d are 
inputs to the Lighting unit 1 100, as described in Figure 

55 11. 

[0029] The main output of the illumination stage 
200 is an illuminated sample 106 with Red, Green, Blue 
color components, and an Alpha components. The 
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other two outputs are GmRange Valid 107, and the sign 
1 08 of the dot product of the gradient vector and the eye 
vector (G uvw • E uvw)- Tne value GmRange Valid is 
the result of comparing the computed gradient magni- 
tude squared against a range defined in a range regis- 
ter. This signal can be used downstream in the 
compositing stage 140 of the pipeline 100 to further 
modify the resultant image by selectively including or 
excluding samples from being composited based upon 
their gradient magnitude. 

[0030] The sign of the dot product indicates 
whether the gradient is front-facing or back-facing. This 
signal can also be used downstream in the compositing 
stage to identify a sample as being on a front -facing or 
backrfacing surface. With this information, a simple seg- 
mentation of the volume data is possible. Like the input, 
the output is also clocked at the rate of one illuminated 
sample pipeline cycle. 

Gradient Magnitude Modulation 

[0031 ] Figure 3 shows the gradient magnitude mod- 
ulation unit 300 in greater detail. The purpose of the unit 
is to filter gradients using their magnitudes. Filtering 
accentuate surfaces, and removes noise. 
[0032] The unit 300 includes an arithmetic logic unit 
310 for taking the dot product of the gradient 104 with 
itself (G 

uvw * G uvw)* thereby obtaining the square of 
its magnitude I G 2 I, and a unit 600 { is this the right 
number ? } for taking the square root of I G 2 I described 
in greater detail with reference to Figures 12 and 13. 
The output of the squaring circuit 310 is supplied to a 
comparator 320 along with range values from a Gradi- 
entMagnitudeRange register 400 shown in Figure 4. 
The range values include a minimum and maximum 
valid magnitude. The output is also truncated by circuit 
330, for example, a shift register, and then supplied to 
the multiplexer 340 along with I G I. 
[0033] The output of the mux 340 is used to index a 
gradient magnitude look-up table (GMLUT) 380, the 
entries of which are representations of fractional num- 
bers in the range zero to one, inclusive. The absolute 
value I G I is also provided to a high pass filter (Hi-Pass) 
filter function 350. A signal selecting a particular modu- 
lation mode is provided on line 360 to a multiplexer 370. 
[0034] This signal is derived from a gradient magni- 
tude modulation register (GMM) 500 shown in Figure 5. 
The parameter values stored in the register 500 as bits 
can be supplied by the user. Possible modes include 
various combinations of specular, diffuse, emissive, 
opacity, high pass diffuse, and high pass specular. 

Gradient Magnitude Modulation Register 

[0035] As shown in Figure 5, the GMM 500 includes 
fields 501 -507 stored as 32 bits. The various bits control 
exactly how the user desires to have the modulation 
performed. The grain, base, upper and lower range, and 


index source field 501-504 are used in conjunction with 
the GMLUT 380. The two high pass fields 505-506 are 
used by the high pass function 350. Field 505 specifies 
a step value for a high pass filter function. Field 506 
5 eliminates either specular or diffuse lighting, or both. 
The values in field 507 select a complex modulation 
mode for the mux 370 using the magnitude look-up 
table 380. 

[0036] In other words, there are a total of thirty-two 
w control bits in the GMM register 500 that control the 
application of the two modulation functions (Hi-Pass or 
GMLUT) to the four modulation outputs 390. GMOM 
and GM/M e can have either the GMLUT output or the 
value 1 .0 applied to them based upon the setting of the 
75 modulateOpacity and modulateEmissive control bits 0 
and 1 , in the notation of the C programming language: 

GMOM = modulateOpacity ? GMLUTf \G\] : 1.0 
GMIM e = modulateEmissive ? GMLUTf \G\] ; 1.0. 

20 

[0037] Here, the "?" operator "asks" whether the 
named control bit is set or not in the GMM 500, and 
selects the first or second of the following two operands 
accordingly. GMIM d and GMIM S can have any of the 
25 four following values: 

1.0, Hi-Pass ( \G\ ), GMLUT [ \G\ ], or Hi-Pass(::\G\ 
)* GMLUTf \G\ ]. 

30 [0038] Note, as shown above, it is possible to com- 
pound the two function values. Any of these four possi- 
ble values can be independently selected for GMIM d 
and GMIM S as follows: 

35 GMIM d = ( modulateDiffuse ? GMLUTf \G\ ] : 1.0 ) 
* ( hiPassDiffuse ? Hi-Pass( \G\ ) : 1.0 ) 
GMIM S = ( modulateSpecular ? GMLUTf \G\ ] : 1.0 
) * ( hiPassSpecular ? Hi-Pass( \G\ ) : 1.0 ) 

40 depending on the setting of the control bits of the GMM 
500. 

Gradient Magnitude Modulation Operation 

45 [0039] The unit 300 determines the modulation 
(attenuation) factors GMOM, GMIM e , GMIM d , and 
GMIM S 390 according to the selection signal on line 360 
and the gradient magnitude of the classified sample 
205. The modulation factors can be applied to lighting 

so parameters (l d , l s , and kg) and the opacity of the sam- 
ple. 

[0040] The square (IG 2 I) of the gradient magnitude 
is computed in unit 31 0 by taking the sum of the squares 
of the components of the gradient vector as follows: 

55 

IG 2 l=(G u *G u )-h(G v *G v )-h(G w *G w ) 
[0041] The gradient vector components are in the 
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range of [-4095, .... +4095] 24 . Given this range, the 
range of the computed square of the gradient magni- 
tude is [0, 50,307,075]. The GmRange Valid signal 
107 is set as follows: 

GmRange Valid = (\G 2 \ >= GradientMagnitud- 
eRange.Min) && <= 

GradientMagnitudeRange. Max) . 

where the GradientMagnitudeRange register 400 is 
shown in Figure 4, and where "&&* is the logical AND 
operator notation of the C programming language. 
[0042J The four modulation factors output by the 
modulation unit 300 are GMOM, GMIM e , GMIM d , and 
GMIM S 390. These outputs are in the range of [0.0, .... 
1.0]. As can be seen in Figure 2 using multiplication 
logic, GMOM modulates the opacity (alpha) component 
of the sample, GMIM e modulates ke, and thus emissive 
lighting, GMIM d modulates l d , and thus diffuse lighting, 
and GMIM S modulates l s , and thus specular lighting. 
[0043] This modulation can be used for a variety of 
reasons: minimize or eliminate lighting contributions of 
non-surfaces; minimize or eliminate lighting contribu- 
tions of samples with low gradients that might exist due 
to errors in sampling and/or interpolation or noise errors 
inherent in the volume data set; apply light to only those 
samples with gradients in a specific range; and include 
or exclude samples from being composited (GMOM). 
The modulation factor GMOM can, for instance, enable 
compositing of only homogenous regions by eliminating 
all surfaces or conversely, enable compositing of only 
surfaces. 

[0044] As an advantage, two modulation functions 
are provided by the unit 300, namely a complex function 
using a gradient magnitude look-up table (GMLUT) 380, 
and the step filter function 350. 

High Pass Filter Function 

[0045] The high pass filter function operates on the 
approximated gradient magnitude. This step function 
produces a high pass modulation factor of either 0.0 or 
1 .0 to either side of a step value in the gradient magni- 
tude range as defined by the hiPassStart field 505 of the 
GMM register 500, shown in Figure 5. The following 
equation represents the step function: 

hiPassOutput = (\Gi >= hiPassStart) ? 1.0:0.0 


Gradient Magnitude Look-up Table 


[0047] As shown in Figure 3, the GMLUT 380 takes 
either IGI, or the most significant, for example, thirteen 
5 bits of IG 2 I as input. The selection through multiplexer 
340 is controlled by the indexSource field 504 of the 
GMM register. The truncated magnitude squared is 
used if the indexSource signal is true, and the magni- 
tude IGI is used otherwise. 
10 [0048] Using IGI gives the user a linear function 
with GMLUT table entries spread at equal points across 
the selected gradient magnitude range. 
[0049] However, the square root approximation can 
be prone to error so it may be advantageous to use IG 2 I 
15 directly. Using the most significant bits of the IG 2 I yields 
a non-linear function with GMLUT entries packed closer 
together at the lower end of the gradient magnitude 
range. This is actually desirable and intended because 
most attenuation of lighting will be done at the low-end 
20 of the gradient magnitude range. 

[0050] The GMLUT is organized as 128 entries 
(entryO t entry127). Each entry is eight bits wide and 
stores a value in the range [0.0, .... 1.0]. The look-up is 
controlled by the grain, base, upperRangeDefault and 
25 lowerRangeDefault fields 501-504 of the GMM register 
500. These fields allow the user to specify how the 128 
table entries are spread across the table's 13-bit index 
range. 

[0051] The base field 502 specifies where in the 
30 index range the first entry (entryO) of the table is 
indexed. The grain field 501 specifies how far apart the 
table entries are spread starting at the base entry. In 
other words, the grain is the size of the incremental 
value between the entries. If the table is programmed to 
35 cover less than the 13-bit index range, then the upper- 
RangeDefault and lowerRangeDefault fields 503-504 
specify the GMLUT output value for the uncovered 
regions above and below, either region can be zero or 
one. 

40 [0052] Figure 7 shows an example complex attenu- 
ation function 700 where the x-axis indicates the gradi- 
ent index in the range of [0, .... 4k-1], and the y-axis the 
GMLUT output value in the range [0.0, 1.0]. In this 
example, the base is 1536, and the grain is 2. Interpola- 

45 tion is performed between the two nearest table entries, 
and an 8-bit repeating fraction result is produced, again 
representing the range of [0.0, 1 .0]. 


[0046] Figure 6 shows an example output 600 for 
this step function. The x-axis depicts the lower-end of 
the input gradient's magnitude range [0, 255], and 
the y-axis the magnitude of the high pass output. In this 
example, the step value hiPassStart is set to 96. Thus, 
for all samples with gradient magnitudes below 96, the 
output is 0.0, otherwise, the output is 1 .0. 


50 


Reflectance Mapping 


[0053] As shown in Figure 8a, the reflectance map- 
ping unit 800 includes a diffuse reflectance map 810, 
and a specular reflectance map 820. The unit also 
includes a reflectance vector circuit 830 for deriving a 
55 reflection vector 802 from an eye vector (E uvw ) 801 and 
the gradient vector 104 (see also Figures Bb and 10). A 
mux 840 selectively chooses to index the specular 
reflectance map directly with either the gradient vector 
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or the computed reflection vector 802. The inputs to the 
units are the gradient and eye vectors 1 04, 801 , and the 
outputs are the diffuse and specular intensities (l d , l s ) 
803-804. 

[0054] The reflectance mapping unit 800 deter- 5 
mines the specular and diffuse intensities (l s and l d ) for 
each sample 205 based upon its associated gradient 
vector 104 and the user-specified eye vector (E uvw ) 
801. As shown, the diffuse map 810 is indexed by the 
sample's gradient vector 104, whereas the specular io 
map 820 is typically indexed by either the gradient vec- 
tor or the computed reflection vector 802 depending on 
a bypass (bypassRefVec) signal 901 shown in Figure 9. 
[0055] The maps and the indexing vectors are all 
specified in unpermuted (U, V, W) object space but rel- 15 
ative to "physical" or "lighting" space. The advantage of 
this is that the reflectance maps do no have to be recal- 
culated for different view directions. However, gradients 
estimated from anisotropic or non-orthogonal volume 
data sets must be corrected to "physical" space for the 20 
lighting calculations to work correctly, that is, the same 
visual appearance will be given, regardless of gantry tilt 
or scale. The specular map 820 may be indexed directly 
by the gradient vector 104, instead of by the reflection 
vector 802, by setting a bit in a bypassRefVec field 901 25 
in an Eye Vector register 900 to true as shown in Figure 
9. The other fields 902-904 of the register 900 respec- 
tively store the (U, V, W) components of the eye vector. 

Reflection Vector 30 

[0056] Figure 10 shows the relationship between 
the eye, reflection, and gradient vectors. The eye vector 
801 is defined to be the vector from the point on a "sur- 
face" of the volume 1000 to the eye 1001. Its coordi- 35 
nates are specified in (U, V f W) object space by fields 
902-904. Note, this vector is normalized to a length of 1 . 
The reflection from a light source 1002 to the eye 1001 
is dependent upon the gradient vector 104. 
[0057] As shown in Figure 8b, the reflectance vec- 40 
tor circuit 830 derives the reflection vector 802 based 
upon the eye vector 801 specified by the Eye Vector 
register 900 and the gradient vector 104. The gradient 
vector is not of unit length, i.e., it is unnormalized. Using 
arithmetic logic units (scaling unit 851, two dot product 45 
generators 852, two multipliers 853, and adder 854), the 
circuit 830 determines an unnormalized reflection vec- 
tor Ru as: 

Ru = 2* Gu* (Gu • E) - E(Gu • Gu) so 

where Gu is the unnormalized gradient vector, and E 
are the reflection and eye vectors, and • is the "dot 
product" operator of two vectors. Note, only the direc- 
tion, and not magnitude, is important for the reflection 55 
vector to index the reflectance map. 
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Reflectance Map 

[0058] As previously mentioned, the specular and 
diffuse reflectance maps use the same organization. 
Each reflectance map is organized as a table with, for 
example, 1536 entries. The entries are spread across 
the six faces of an imaginary cube in 3D, that is 256 
entries on each face. Each face includes four quadrants 
of 64 entries. The index to the maps are the unnormal- 
ized gradient vector or the reflection vector as selected 
by the mux 840. Again, magnitude is not important, but 
direction is. 

[0059] The outputs are values, interpolated from 
four entries of the map, based on the direction of the 
incoming vector. The selection of the face of the cube 
for access is based on the maximum vector component, 
and its sign. For instance, if the vector is (75,0,0) in 
(u,v,w) space, then the right face of the cube (positive 
U) would be chosen. Whereas, if the vector is (-75,0,0), 
then the left face of the cube is chosen. The quadrant of 
a face is then selected based upon the sign of the other 
two vector components. 

[0060] Finally, a cluster of four neighboring table 
entries is selected for interpolation to a resultant inten- 
sity value. This neighborhood is selected by computing 
two weights that indicate the angle of deflection of~the 
vector from the center of the cube's face to the outer 
edges of the face. Given that there are a power-of-two 
entries in each direction of a face's quadrant and the 
vector's components are represented by a power-of-two 
value, these weights can easily be derived by simple bit 
extraction of the vector's components. 

Lighting 

[0061] Figure 11 shows the lighting unit 1100 in 
greater detail. The unit comprises a number of arithme- 
tic logic units (ALUs) that add (0) and multiply (<8>) sig- 
nals derived by the modulation and mapping units, and 
clamps. The lighting unit 1100 applies the diffuse and 
specular lighting coefficients, k<j and kg, the modulated 
emissive, diffuse, and specular intensities (Mkg, Ml d , 
Mi s ), and the specular color (R s , G s , B s ) 1101 to the 
classified RGBa sample 205. 

[0062] The lighting equations, implemented by the 
ALUs, for each of the three color channels can be stated 
as follows: 

Red = [((Ml d *k d )+Mk e rRa^fJ + [(Ml s * k s 
) (^specular a sample)] 

Green = [((Ml d * k d )+ Mk e rGa sampU J + [(Ml s * k s 

) ^specular ^sample)] 

Blue = [((Ml d *k d h Mk e )'B asample ] + [(Ml, * k s )' 

& specular * a sample)]* 

where the colors are opacity weighted. 
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Gradient Magnitude Square Root Approximation 

[0063] As stated above, the gradient magnitude \G\ 
is derived from a square root approximation of IG^I. The 
approximation is based on a Newton-Raphson approxi- 5 
mation. Generally, Newton's method involves numerous 
iterations to find the square-root of an input number 
Recall from above the input is: 

\G 2 \ = (G a * Gu) + (G v * G v ) + (G w * G w ) w 

For the purpose of determining the gradient magnitude, 
the accuracy of the square root is not as critical as the 
number of gates in a pipelined a hardware implementa- 
tion. Therefore, this embodiment uses a one step ver- 15 
sion of the method. 

[0064] The next section will discuss the Newton- 
Raphson method for approximating square roots that is 
commonly used in the prior art in an iterative non-pipe- 
lined fashion, (non-pipelined) followed by the details on 20 
a preferred implementation for a pipeline, and its advan- 
tages over prior art approximations. 

Newton-Raphson 

_ 25 

[0065] The Newton-Raphson method is an iterative 
algorithm, based on tangents and their midpoints along 
a specified curve, in this case, the square root curve. 
The method works as follows: 

30 

1. First, an intelligent guess (g) of the answer is 
derived based on the input number (n). 

2. Next, the result of dividing the input number by 
the guess is derived (div): 35 

div = n/g 

3. Then, an error is computed to determine how far 

off the guess was: 40 

error = \div-g\ 

If g had been the exact answer, it is easy to see 
how the error would be zero. 45 

4. If the computed error is too large, a new guess is 
ventured by computing 

the midway point along a tangent, defined by a line 
drawn between the current guess (g) and div, as 50 
follows: 

g= 1/2* (g+ div) 

5. Steps 2 through 4 are repeated (iterated) until the 55 
error is within acceptable limits. 

[0066] Figure 12 graphically shows how the New- 
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ton-Raphson method for an example number 163. In 
Figure 12, the x-axis indicates the input number, and the 
y-axis the square root. The curve 1200 plots the square 
root function. The input number (163 is located between 
the two power-of-two numbers: 128 (2 7 ) and 256 (2 s ). 
Thus the computed square root of the lower bound 
(128) is chosen for the first guess. This is 11.3137. The 
division result, dividing the input number (163) by the 
guessed answer 1 1.3137 yields 14.4073. This results in 
an error of 3.093 (14.4073*11.3137). The next guess is 
computed as follows: 

NewGuess = 1/2 * (1 1.3137 + 14.4073) = 12.8605 

[0067] This process would then continue to what- 
ever precision is desired. The correct answer is 
12.767145. 

[0068] Note, this method uses both division and 
iteration. Division is extremely expensive in circuitry, 
and iteration inconsistent with a pipelined architecture. 
The multiplication by 1/2 can be accomplished by a sim- 
ple shift right of the binary number. There are also a 
subtraction and possible complement, e.g., another 
adder, and an addition required for each iteration. 

Prior Art Hardware Implementations 

[0069] Most prior art hardware implementations of 
Newton-Raphson's method for approximating a square 
root use an iterative, non-pipelined implementation. 
This is in order to reduce the number of required gates 
for the design. If the typical design is converted to a 
pipelined implementation, the divider, adders, and sub- 
tracter would have to be replicated in successive pipe- 
line stages, once for each iteration. Moreover, a 
pipelined implementation cannot support a variable 
number of steps; instead, circuitry would have to be rep- 
licated as many times as the maximum number of 
guesses. This would result in an large number of gates. 
Many implementations take as many as 20 or 30 itera- 
tions to compute a result which would introduce a huge 
amount of delay and circuitry into a pipelined architec- 
ture. 

[0070] As an example implementation, the Synop- 
sys company offers a square root circuit (DW02_sqrt: 
Combinatorial Square Root) in their Design Ware library 
based on Newton-Raphson, see "wwwsynopsys.com." 
These are non-pipelined devices of which there are two 
variants with the following typical characteristics: either 
300 ns and 9000 gates, or 600 ns and 1100 gates 
based on a cycle time of approximately 10 nanosec- 
onds. These, of course, reuse the same divider, adder, 
and subtraction circuits for each of 30-60 iterations, pre- 
cluding pipeline operation. 

Pipelined Square Root 

[0071] A preferred implementation is based on 
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Newton-Raphson's method but varies significantly in 
that it is pipelined. The present implementation employs 
only one iteration and assumes predefined estimates of 
the square root at predefined points along the curve 
1 200 and tangents with pre-defined "slopes" connected, 
end-to-end, to approximate the square root function. As 
a further requirement in order to minimize the number of 
gates, division and multiplication are not used, and all 
computations are merely shifts and adds. 
[0072] The invention takes advantage of the fact the 
square root of a number expressed as a power-of-two 
(2") is 2 n/2 . So, a first approximation is made by a sim- 
ple range determination. For a given input find a nearest 
power-of-two number, and use its square root as the 
first guess. Now, if the range check is done for odd pow- 
ers-of-two (i.e., in 2 n , n is odd), the first approximation 
will be in the middle of a range reducing the largest pos- 
sible error by half. 

[0073] Figure 13 is a block diagram of a preferred 
implementation of a square root approximation unit 
1 300. The unit includes a combinatorial logic block 1310 
labeled "Select Range & Guess," another block of com- 
binatorial logic 1320 labeled "Divide Input by Guess," an 
adder 1330, and a shifter 1340. The unit 1300 takes a 
number (for example, IG 2 l) as input ^30^ , and produces 
an approximated square root as output 1309. 
[0074] Essentially, the block 1310 determines 
guess 1311 and shift 1312. The value guess is the 
nearest square root, expressed as a power-of-two 
number, of a largest odd power-of-two number less than 
or equal to input. This range test can be as a simple bit 
test operation. The range test can begin at 32,768 (hex 
0x8000 or 2 15 ) which has a nearest square root of 256 
(2 8 ). In other words, because n is odd, the root is 
"guessed" as 2 (n + 1)/2 . The corresponding initial guess 
is 256, and shift is 8. 

[0075] Block 1 320 divides input by guess. Because 
guess is a power-of-two, the divide can be done as sim- 
ple shift operation. The adder 1330 adds guess to the 
result of input /guess, The shifter 1340 implements the 
final divide by two: 

output = (guess + (input / guess)) /2, or 
output = (2 (n + 1)/2 + (input/2 (n ^ 2 ) /2. 

By choosing a good value for guess, that is make n odd, 
the approximation is very accurate. 
[0076] Because guess is always a power-of-two, 
the divide is simplified to a shift of the input. Then, 
according to the Newton-Raphson method, the guess is 
added to the result of dividing the input by the guess by 
the adder 1340. The sum is then divided by two in the 
shifter 1340 to give a close approximation of the square 
root of the input. 

[0077] Taking the same example as was used 
above, if the input is 163, then the input >= 0x0080 or 
128 (2 7 ), and the guess is 1 6 (shift 4), and 


output = (16 + (163/16))/ 2 = 13, 

that is, the square root of 163 rounded to the nearest 
integer. 

5 [0078] Figure 14 is a graph 1400 comparing the 
exact gradient magnitude 1401 with the approximate 
gradient 1402, and the error in the approximation 1403. 
[0079] This circuit requires a very small number of 
gates to implement. Additionally, it the circuit is well 

io suited to a pipelined design as the logic may be spread 
over as many pipe stages as desired without having to 
replicate any logic because no loops or iterations are 
involved. An actual implementation of the circuit 1300 
takes 850 gates and has a propagation delay of 5 nano- 

15 seconds, compared with 300 Ns and 9000 gates from 
above. 

Generalized Function Approximation 

20 [0080] At first blush, it might appear that the above 
described single iteration of Newton-Raphson can eas- 
ily be extended to a fixed number of additional iterations 
in a pipelined fashion to improve precision. However, 
the method described above relies on all computations 

25 involving powers -of -two. This will no longer be the case 
in a second, follow-on iteration. In the second iteration, 
it is necessary to use the result from the first iteration in 
the divide operation. The result will most likely not be a 
power-of-two number, so a complex divider circuit would 

30 have to be used, which would be very costly in gates 
and delays. 

[0081] However, the method can be improved to 
provide a better approximation without increasing the 
number of iterations, but rather by piecewise linear 

35 approximation of the square-root function that involves 
division by a fixed set of numbers that are not powers of 
two. The set of numbers is chosen so that division is can 
still be accomplished by a small number of shifts and 
adds in a fixed number of steps. 

40 [0082] Consider for example the range of guesses 
1310 in Figure 13. Suppose that the difference between 
possible guesses 128 and 256 is too great for the level 
of accuracy desired. It really is desired to select a guess 
part way between these two, and still be able to obtain 

45 the quotient input /guess efficiently. One way is to take 
the average of input/ 128 and input/ 256, a number that 
is easy to compute with an additional adder and shift. 
Let n be the input number as above. Then the average 
(n/128) + (n/256)) /2 is given by 

50 

((n/128) + (n&56)) / 2 = (n/256 + 2n/256y2 = 
3n/512 = n/(512/3). 

[0083] That is, simply sum the number n shifted by 
55 seven bits with the number n shifted by eight bits, then 
shift the result by one bit. This turns out to be the same 
as dividing n by 512/3, which is approximately 170.667, 
or nearly 171. The division is accomplished with an 
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adder and two shifts, which is much more effective than 
a full divider circuit. 

[0084] The effect is to decrease the size of the 
ranges for the first guess by doubling the number of 
points at which first "guess" is taken of the square root 
of the input. This reduces the maximum error shown in 
Figure 14 in this modified single-step approximation of 
the square root. 

[0085] Note that the precision of the approximation 
can be increased even more by increasing the number 
of adders and shift operations performed in the single 
step. For example, the following 3 rd order approximation 
requires two adders and three shifts: 

n/256 = n» 8 

n/204 * (n/256 + n/171) » 1 = (n/256 + ((n/256 + 

n/128)» 1))» 1 

n/171 * (n&56 + n/128) » 1 

n/146 « (nf!71 + n/128) » 1 = (((n/256 + n/128) 
» 1) + n/128) » 1 
n/128 = n » 7 

[0086] Another way of considering this is to note 
that by combining different shifted-down values in differ- 
ent ways, many differently sloped tangents can be pro- 
duced along the curve representing the square root 
function. In a preferred method, the starting point is 
selected from a range including the input number, and 
the sloped" tangent to be applied from that point to the 
next range. 

[0087] In general, suppose that the range of the 
square root function has the following predetermined 
guesses: 

9o> 9i> 92* ■■■> 9b 9i+i, ... 

where the g f are chosen so that division can be accom- 
plished by a fixed set of circuitry in a fixed amount of 
time. Then the choice of guesses can be predetermined 
to minimize the amount of error between the guess and 
the actual square root. Specifically, if the input value n 
lies between g, 2 and g l+1 2 f then the error in the approx- 
imation based on the these two guesses will be 


V2(n/g r g f ) and Vfc( g M -n/ 'g, + 1 ) t 

respectively. The value of n below which g f is a better 
guess and above which g i+1 is a better guess is the 
value for which these two errors are equal - i.e., for 
which 

^(n/ g r g f ) = V6( g i+1 -n/ g i+1 ). 

Solving for n, it can be seen that if n < g t * g i+1 , then g f 
is the better guess, otherwise g i+1 is the better guess. 
[0088] Therefore, for the sequence of guesses g a 
9p 92* 9b 9i+i, there is a corresponding sequence of 
selection ranges g 0 * g 1f gi * g2y g 2 * g 3> .... g,* g i+h ... 
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against which n is tested in block 131 0 of Figure 13. So 
rather than having guesses spaced at odd powers-of- 
two in large ranges that are powers-of-four apart (2, 8, 
32, 128, 512, 2K, 8K, 32K) as in block 1311, one can 
have them spaced any difference apart, even different 
distances for the same function. 

[0089] While this description is specific to the 
square root function, the method and apparatus as 
described above can be generalized to approximating 
any function, linear or non-linear. The function resolved 
is represented by sufficient connected tangents to 
approximate the function. Starting points defining the 
range of the tangents can be stored as a table along 
with the initial guesses and slopes. Then, simple logic 
similar to the logic described with reference to Figure 13 
can be used to approximate arbitrary functions to what- 
ever level of precision with a minimal number of gates in 
a pipelined manner. 

[0090] It is to be understood that various other 
adaptations and modifications may be made within the 
spirit and scope of the invention. Therefore, it is the 
object of the appended claims to cover ail such varia- 
tions and modifications as come within the true spirit 
and scope of the invention. 

Claims 


A method for modulating samples in a volume ren- 
dering pipeline, comprising the steps of: 

storing modulation values as entries in a table; 
storing a grain and a base for the entries of the 
table to specify an index range; 
determining a magnitude of a gradient vector of 
a sample; 

indexing the table using the magnitude to 
determine two modulation values correspond- 
ing to the magnitude; and 
interpolating the two modulation values linearly 
using the grain and the base to determine a 
modulation factor for the sample. 

2. The method of claim 1 wherein the base specifies a 
first modulation value of the table, and the grain 
specifies the size of an increment between succes- 
sive entries of the table. 

3. The method of claim 1 or 2 further comprising: 

setting storing a lower range default and an 
upper range default for the entries of the table; 
setting the modulation factor to the lower range 
default if the magnitude is less than the index 
range; and 

setting the modulation factor to the upper range 
default if the magnitude is greater than the 
index range. 
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4. The method of claim 3 wherein the lower range 
default is selected to be either zero or one. 

5. The method of claim 3 wherein the upper range 
default is selected to be either zero or one. 5 

6. The method of claim 1 wherein the gradient vector 
has components G Ut , Gy , and G w , and further 
comprising the steps of: 

summing the squares of the components to 
determine a squared gradient magnitude / G 2 1 
, and 

taking the square root of the squared magni- 
tude / G 2 I to determine the magnitude / G / of 
the gradient vector. 

7. The method of claim 1 wherein modulating is per- 
formed in an illumination stage of the rendering 
pipeline. 20 

8. The method of claim 1 wherein the modulation fac- 
tor modulates an opacity of the sample. 

9. The method of claim 1 wherein the modulation fac- 25 
tor modulates emissive lighting of colors of the 
sample. 

10. The method of claim 1 wherein the modulation fac- 
tor modulates diffuse lighting of colors of the sam- 30 
pie. 

11. The method of claim 1 wherein the modulation fac- 
tor modulates specular lighting of colors of the sam- 
ple. 35 

12. The method of claim 6 further comprising: 

truncating the high order bits of the squared 
magnitude; 

indexing the table using the truncated squared 
magnitude to determine two modulation values 
corresponding to the truncated squared magni- 
tude; and 

interpolating the two modulation values using 
the grain and the base to determine a modula- 
tion factor for attenuating lighting at a low-end 
of the index range by modulating the sample 
with a non-linear function. 

13. The method of claim 12 further comprising: 

selectively indexing the table by either the gra- 
dient magnitude or the truncated squared mag- 
nitude depending on an index source signal. 55 
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(54) Method for modulating volume samples in a rendering pipeline 


(57) A method modulates samples in a volume ren- 
dering pipeline by storing modulation values as entries 
in a table. Also stored are a grain and a base for the 
entries of the table to specify an index range. A magni- 
tude of a gradient vector of a sample is determined. The 


table is indexed using the magnitude to determine two 
modulation values corresponding to the magnitude. The 
two modulation values are interpolated using the grain 
and the base to determine a modulation factor to mod- 
ulate the sample with a linear function. 
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